使用立体视觉信息的视线追踪系统设计

doi:10.13190/jbupt.201001.47.211

北京邮电大学学报 ›› 2010, Vol. 33 ›› Issue (1): 47-51.doi: 10.13190/jbupt.201001.47.211

使用立体视觉信息的视线追踪系统设计

张鹏翼¹；王志良¹；郑思仪^1,2；张琼¹

（1. 北京科技大学信息工程学院，北京 100083； 2.武警北京指挥学院，北京 100012）

收稿日期:2009-04-29 修回日期:2009-08-31 出版日期:2010-02-28 发布日期:2010-02-28
通讯作者: 张鹏翼

The Research of Eye gaze Tracking System Using Stereovision information

ZHANG Peng-yi¹；WANG Zhi-liang¹；ZHENG Si-yi^1,2；ZHANG Qiong¹

（1.School of Information Engineering, University of Science and Technology Beijing, Beijing 100083, China;2.Beijing Command College of Chinese Peoples Armed Police Force, Beijing 100012, China）

Received:2009-04-29 Revised:2009-08-31 Online:2010-02-28 Published:2010-02-28
Contact: ZHANG PengYi

摘要/Abstract

摘要：

为提高视线方向计算精度，研制了一种基于立体视觉的视线追踪系统. 首先设计了一种可产生相邻2帧“亮暗瞳”图像的双摄像机红外光源，使用图像做差和椭圆拟合的方式计算瞳孔中心，结合在“暗瞳”图像中得到普洱钦斑中心，确定局部视线的盯视方向. 然后根据人类视线移动特点，提出使用神经网络结合卡尔曼滤波的方法进行瞳孔跟踪，用支持向量回归对人眼立体参数、局部视线盯视方向和盯视点之间的关系进行训练，得到视线映射模型. 实验结果表明，该系统能基本消除用户大范围头动的干扰.

关键词: 视线追踪, 人机交互, 瞳孔, 普尔钦斑

Abstract:

To improve the calculative precision of gaze direction, an eye gaze tracking system using stereovision information is designed, it composes of two charge coupled device cameras and a novel loop illuminator. Pupil position is got through doing subtraction of the two adjacent images, “bright pupil” and “dark pupil”, which are gained by illuminating users eyes alternately. Local gazing direction is the vector difference between the Purkinje image in “dark pupil” and pupil center located by ellipse fitting. Pupil tracking is designed using neural network combined with Kalman filtering, and mapping model from 3D parameters to gaze point is worked out via support vector regression. Experiment proves that this system can most eliminate the interference from users head motion.

Key words: eye gaze tracking, human-computer interaction, pupil, Purkinje image

张鹏翼1 ；王志良1 ；郑思仪1,2 ；张琼1. 使用立体视觉信息的视线追踪系统设计[J]. 北京邮电大学学报, 2010, 33(1): 47-51.

ZHANG Peng-yi¹；WANG Zhi-liang¹；ZHENG Si-yi^1,2；ZHANG Qiong¹. The Research of Eye gaze Tracking System Using Stereovision information[J]. JOURNAL OF BEIJING UNIVERSITY OF POSTS AND TELECOM, 2010, 33(1): 47-51.

参考文献

[1] Morimoto C H, Mimica R M. Eye gaze tracking techniques for interactive applications[J]. Computer Vision and Image Understanding, 2004, 98(1): 4-24.
[2] Wang Jiangang, Sung E. Study on eye gaze estimation[J]. IEEE Trans on Systems, Man, and Cybernetics, 2002, 32(3): 332-350.
[3] 蒋恩松, 李孟超, 孙刘杰. 一种基于神经网络的卡尔曼滤波改进方法[J]. 电子与信息学报, 2007, 29(9): 2073-2076. Jiang Ensong, Li Mengchao, Sun Liujie. An improved method of Kalman filter based on neural network[J]. Journal of Electronics & Information Technology, 2007, 29(9): 2073-2076.
[4] 张鹏翼, 王志良, 迟健男. 一种非接触式实时视线追踪系统的设计[J]. 北京科技大学学报, 2009, 31(5): 655-659. Zhang Pengyi, Wang Zhiliang, Chi Jiannan. Design of a real-time eye tracking system based on contactless configuration[J]. Journal of University of Science and Technology Beijing, 2009, 31(5): 655-659.
[5] 王勇, 许录平. 独立成分分析和支持向量机的虹膜识别方法[J]. 电子科技大学学报, 2007, 36(3): 583-586. Wang Yong, Xu Luping. Iris recognition method based on independent component analysis and support vector machine[J]. Journal of University of Electronic Science and Technology of China, 2007, 36(3): 583-586.
[6] Shih S W, Liu Jin. A novel approach to 3-D gaze tracking using stereo cameras[J]. IEEE Trans on Systems, Man, and Cybernetics, 2004, 34(1): 234-245.
[7] Beymer D, Flickner M. Eye gaze tracking using an active stereo head//Proceedings of Computer Vision and Pattern Recognition. New York: Elsevier Science Inc, 2003: 451-458.
[8] Zhu Zhiwei, Ji Qiang. Novel eye gaze tracking techniques under natural head movement[J]. IEEE Trans on Biomedical Engineering, 2007, 54(12): 2246-2260.
[9] Zhu Zhiwei, Ji Qiang. Eye and gaze tracking for interactive graphic display[J]. Machine Vision and Applications, 2004, 15(3): 139-148.
[10] Guestrin D, Eizenman M. General theory of remote gaze estimation using the pupil center and corneal reflections[J]. IEEE Trans on Biomedical Engineering, 2006, 53(6): 1124-1133.
[11] Villanueva A, Cabeza R. A novel gaze estimation system with one calibration point[J]. IEEE Trans on Systems, Man, and Cybernetics, 2008, 38(4): 1123-1138.

使用立体视觉信息的视线追踪系统设计

The Research of Eye gaze Tracking System Using Stereovision information

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 2

编辑推荐

Metrics

本文评价

[1]	黄毅, 冯俊兰, 胡珉, 吴晓婷, 杜晓宇. 智能对话系统架构及算法[J]. 北京邮电大学学报, 2019, 42(6): 10-19.
[2]	贾庆轩, 孙汉旭, 李峰, 阮瑞卿. 健身车人机交互系统的研究与实现[J]. 北京邮电大学学报, 2006, 29(s2): 83-87.